Joint intent detection and slot filling with wheel-graph attention networks

نویسندگان

چکیده

Intent detection and slot filling are recognized as two very important tasks in a spoken language understanding (SLU) system. In order to model these at the same time, many joint models based on deep neural networks have been proposed recently archived excellent results. addition, graph network has made good achievements field of vision. Therefore, we combine advantages propose new with wheel-graph attention (Wheel-GAT), which is able interrelated connections directly for single intent filling. To construct structure utterances, create nodes, directed edges. nodes can provide utterance-level semantic information filling, while also local keyword detection. The promote each other carry out end-to-end training time. Experiments show that our approach superior multiple baselines ATIS SNIPS datasets. Besides, demonstrate using bi-directional encoder representation from transformer (BERT) further boosts performance SLU task.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Joint Intent Detection and Slot Filling Using Convolutional Neural Networks

We describe a joint model for intent detection and slot filling based on convolutional neural networks (CNN). The proposed architecture can be perceived as a neural network (NN) version of the triangular CRF model (TriCRF), which exploits the dependency between intents and slots, and models them simultaneously. Our slot filling component is a globally normalized CRF style model (as opposed to l...

متن کامل

Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling

Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition. In this work, we propose an attention-based neural network model for joint intent detection and slot filling, both of which are critical steps for many speech understanding and dialog systems. Unlike in machine translation and speech recognition, alignment i...

متن کامل

A Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding

Two major tasks in spoken language understanding (SLU) are intent determination (ID) and slot filling (SF). Recurrent neural networks (RNNs) have been proved effective in SF, while there is no prior work using RNNs in ID. Based on the idea that the intent and semantic slots of a sentence are correlative, we propose a joint model for both tasks. Gated recurrent unit (GRU) is used to learn the re...

متن کامل

Position-aware Attention and Supervised Data Improve Slot Filling

Organized relational knowledge in the form of “knowledge graphs” is important for many applications. However, the ability to populate knowledge bases with facts automatically extracted from documents has improved frustratingly slowly. This paper simultaneously addresses two issues that have held back prior work. We first propose an effective new model, which combines an LSTM sequence model with...

متن کامل

Unsupervised Person Slot Filling based on Graph Mining

Slot filling aims to extract the values (slot fillers) of specific attributes (slots types) for a given entity (query) from a largescale corpus. Slot filling remains very challenging over the past seven years. We propose a simple yet effective unsupervised approach to extract slot fillers based on the following two observations: (1) a trigger is usually a salient node relative to the query and ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Intelligent and Fuzzy Systems

سال: 2022

ISSN: ['1875-8967', '1064-1246']

DOI: https://doi.org/10.3233/jifs-211674